Summarizing First-Person Videos from Third Persons' Points of Views

Video highlight or summarization is among interesting topics in computer vision, which benefits a variety of applications like viewing, searching, or storage. However, most existing studies rely on training data of third-person videos, which cannot easily generalize to highlight the first-person ones. With the goal of deriving an effective model to summarize first-person videos, we propose a novel deep neural network architecture for describing and discriminating vital spatiotemporal information across videos with different points of view. Our proposed model is realized in a semi-supervised setting, in which fully annotated third-person videos, unlabeled first-person videos, and a small number of annotated first-person ones are presented during training. In our experiments, qualitative and quantitative evaluations on both benchmarks and our collected first-person video datasets are presented.Comment: 16+10 pages, ECCV 201

How Local is the Local Diversity? Reinforcing Sequential Determinantal Point Processes with Dynamic Ground Sets for Supervised Video Summarization

The large volume of video content and high viewing frequency demand automatic video summarization algorithms, of which a key property is the capability of modeling diversity. If videos are lengthy like hours-long egocentric videos, it is necessary to track the temporal structures of the videos and enforce local diversity. The local diversity refers to that the shots selected from a short time duration are diverse but visually similar shots are allowed to co-exist in the summary if they appear far apart in the video. In this paper, we propose a novel probabilistic model, built upon SeqDPP, to dynamically control the time span of a video segment upon which the local diversity is imposed. In particular, we enable SeqDPP to learn to automatically infer how local the local diversity is supposed to be from the input video. The resulting model is extremely involved to train by the hallmark maximum likelihood estimation (MLE), which further suffers from the exposure bias and non-differentiable evaluation metrics. To tackle these problems, we instead devise a reinforcement learning algorithm for training the proposed model. Extensive experiments verify the advantages of our model and the new learning algorithm over MLE-based methods

Acute immune signatures and their legacies in severe acute respiratory syndrome coronavirus-2 infected cancer patients

Given the immune system’s importance for cancer surveillance and treatment, we have investigated how it may be affected by SARS-CoV-2 infection of cancer patients. Across some heterogeneity in tumor type, stage, and treatment, virus-exposed solid cancer patients display a dominant impact of SARS-CoV-2, apparent from the resemblance of their immune signatures to those for COVID-19+ non-cancer patients. This is not the case for hematological malignancies, with virus-exposed patients collectively displaying heterogeneous humoral responses, an exhausted T cell phenotype and a high prevalence of prolonged virus shedding. Furthermore, while recovered solid cancer patients’ immunophenotypes resemble those of nonvirus-exposed cancer patients, recovered hematological cancer patients display distinct, lingering immunological legacies. Thus, while solid cancer patients, including those with advanced disease, seem no more at risk of SARS-CoV-2-associated immune dysregulation than the general population, hematological cancer patients show complex immunological consequences of SARS-CoV-2 exposure that might usefully inform their care

Multi-messenger observations of a binary neutron star merger

On 2017 August 17 a binary neutron star coalescence candidate (later designated GW170817) with merger time 12:41:04 UTC was observed through gravitational waves by the Advanced LIGO and Advanced Virgo detectors. The Fermi Gamma-ray Burst Monitor independently detected a gamma-ray burst (GRB 170817A) with a time delay of ~1.7 s with respect to the merger time. From the gravitational-wave signal, the source was initially localized to a sky region of 31 deg2 at a luminosity distance of 40+8-8 Mpc and with component masses consistent with neutron stars. The component masses were later measured to be in the range 0.86 to 2.26 Mo. An extensive observing campaign was launched across the electromagnetic spectrum leading to the discovery of a bright optical transient (SSS17a, now with the IAU identification of AT 2017gfo) in NGC 4993 (at ~40 Mpc) less than 11 hours after the merger by the One- Meter, Two Hemisphere (1M2H) team using the 1 m Swope Telescope. The optical transient was independently detected by multiple teams within an hour. Subsequent observations targeted the object and its environment. Early ultraviolet observations revealed a blue transient that faded within 48 hours. Optical and infrared observations showed a redward evolution over ~10 days. Following early non-detections, X-ray and radio emission were discovered at the transient’s position ~9 and ~16 days, respectively, after the merger. Both the X-ray and radio emission likely arise from a physical process that is distinct from the one that generates the UV/optical/near-infrared emission. No ultra-high-energy gamma-rays and no neutrino candidates consistent with the source were found in follow-up searches. These observations support the hypothesis that GW170817 was produced by the merger of two neutron stars in NGC4993 followed by a short gamma-ray burst (GRB 170817A) and a kilonova/macronova powered by the radioactive decay of r-process nuclei synthesized in the ejecta

Acute immune signatures and their legacies in severe acute respiratory syndrome coronavirus-2 infected cancer patients

Given the immune system's importance for cancer surveillance and treatment, we have investigated how it may be affected by SARS-CoV-2 infection of cancer patients. Across some heterogeneity in tumor type, stage, and treatment, virus-exposed solid cancer patients display a dominant impact of SARS-CoV-2, apparent from the resemblance of their immune signatures to those for COVID-19+ non-cancer patients. This is not the case for hematological malignancies, with virus-exposed patients collectively displaying heterogeneous humoral responses, an exhausted T cell phenotype and a high prevalence of prolonged virus shedding. Furthermore, while recovered solid cancer patients' immunophenotypes resemble those of non-virus-exposed cancer patients, recovered hematological cancer patients display distinct, lingering immunological legacies. Thus, while solid cancer patients, including those with advanced disease, seem no more at risk of SARS-CoV-2-associated immune dysregulation than the general population, hematological cancer patients show complex immunological consequences of SARS-CoV-2 exposure that might usefully inform their care

Nutrition and dietary intake and their association with mortality and hospitalisation in adults with chronic kidney disease treated with haemodialysis: protocol for DIET-HD, a prospective multinational cohort study.

INTRODUCTION: Adults with end-stage kidney disease (ESKD) treated with haemodialysis experience mortality of between 15% and 20% each year. Effective interventions that improve health outcomes for long-term dialysis patients remain unproven. Novel and testable determinants of health in dialysis are needed. Nutrition and dietary patterns are potential factors influencing health in other health settings that warrant exploration in multinational studies in men and women treated with dialysis. We report the protocol of the "DIETary intake, death and hospitalisation in adults with end-stage kidney disease treated with HaemoDialysis (DIET-HD) study," a multinational prospective cohort study. DIET-HD will describe associations of nutrition and dietary patterns with major health outcomes for adults treated with dialysis in several countries.METHODS AND ANALYSIS: DIET-HD will recruit approximately 10,000 adults who have ESKD treated by clinics administered by a single dialysis provider in Argentina, France, Germany, Hungary, Italy, Poland, Portugal, Romania, Spain, Sweden and Turkey. Recruitment will take place between March 2014 and June 2015. The study has currently recruited 8000 participants who have completed baseline data. Nutritional intake and dietary patterns will be measured using the Global Allergy and Asthma European Network (GA(2)LEN) food frequency questionnaire. The primary dietary exposures will be n-3 and n-6 polyunsaturated fatty acid consumption. The primary outcome will be cardiovascular mortality and secondary outcomes will be all-cause mortality, infection-related mortality and hospitalisation.ETHICS AND DISSEMINATION: The study is approved by the relevant Ethics Committees in participating countries. All participants will provide written informed consent and be free to withdraw their data at any time. The findings of the study will be disseminated through peer-reviewed journals, conference presentations and to participants via regular newsletters. We expect that the DIET-HD study will inform large pragmatic trials of nutrition or dietary interventions in the setting of advanced kidney disease

Understanding Factors Associated With Psychomotor Subtypes of Delirium in Older Inpatients With Dementia

Objectives: Few studies have analyzed factors associated with delirium subtypes. In this study, we investigate factors associated with subtypes of delirium only in patients with dementia to provide insights on the possible prevention and treatments. Design: This is a cross-sectional study nested in the “Delirium Day” study, a nationwide Italian point-prevalence study. Setting and Participants: Older patients admitted to 205 acute and 92 rehabilitation hospital wards. Measures: Delirium was evaluated with the 4-AT and the motor subtypes with the Delirium Motor Subtype Scale. Dementia was defined by the presence of a documented diagnosis in the medical records and/or prescription of acetylcholinesterase inhibitors or memantine prior to admission. Results: Of the 1057 patients with dementia, 35% had delirium, with 25.6% hyperactive, 33.1% hypoactive, 34.5% mixed, and 6.7% nonmotor subtype. There were higher odds of having venous catheters in the hypoactive (OR 1.82, 95% CI 1.18-2.81) and mixed type of delirium (OR 2.23, CI 1.43-3.46), whereas higher odds of urinary catheters in the hypoactive (OR 2.91, CI 1.92-4.39), hyperactive (OR 1.99, CI 1.23-3.21), and mixed types of delirium (OR 2.05, CI 1.36-3.07). We found higher odds of antipsychotics both in the hyperactive (OR 2.87, CI 1.81-4.54) and mixed subtype (OR 1.84, CI 1.24-2.75), whereas higher odds of antibiotics was present only in the mixed subtype (OR 1.91, CI 1.26-2.87). Conclusions and Implications: In patients with dementia, the mixed delirium subtype is the most prevalent followed by the hypoactive, hyperactive, and nonmotor subtype. Motor subtypes of delirium may be triggered by clinical factors, including the use of venous and urinary catheters, and the use of antipsychotics. Future studies are necessary to provide further insights on the possible pathophysiology of delirium in patients with dementia and to address the optimization of the management of potential risk factors